359 research outputs found
R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object
Rotation detection is a challenging task due to the difficulties of locating
the multi-angle objects and separating them effectively from the background.
Though considerable progress has been made, for practical settings, there still
exist challenges for rotating objects with large aspect ratio, dense
distribution and category extremely imbalance. In this paper, we propose an
end-to-end refined single-stage rotation detector for fast and accurate object
detection by using a progressive regression approach from coarse to fine
granularity. Considering the shortcoming of feature misalignment in existing
refined single-stage detector, we design a feature refinement module to improve
detection performance by getting more accurate features. The key idea of
feature refinement module is to re-encode the position information of the
current refined bounding box to the corresponding feature points through
pixel-wise feature interpolation to realize feature reconstruction and
alignment. For more accurate rotation estimation, an approximate SkewIoU loss
is proposed to solve the problem that the calculation of SkewIoU is not
derivable. Experiments on three popular remote sensing public datasets DOTA,
HRSC2016, UCAS-AOD as well as one scene text dataset ICDAR2015 show the
effectiveness of our approach. Tensorflow and Pytorch version codes are
available at https://github.com/Thinklab-SJTU/R3Det_Tensorflow and
https://github.com/SJTU-Thinklab-Det/r3det-on-mmdetection, and R3Det is also
integrated in our open source rotation detection benchmark:
https://github.com/yangxue0827/RotationDetection.Comment: 13 pages, 12 figures, 9 table
ATP: Adaptive Tensor Parallelism for Foundation Models
Foundation models have impressive performance and generalization capabilities
across a wide range of applications. The increasing size of the models
introduces great challenges for the training. Tensor parallelism is a critical
technique that is currently used in almost all foundation model training and
has a significant impact on overall training performance. However, current
tensor parallelism in machine learning frameworks misses optimization
opportunities in fitting various interconnection topologies. In this work, we
present ATP, an adaptive tensor parallelism framework for foundation models,
which can automatically select the optimal parallel strategy on different
interconnections. We propose column- and row-first tensor parallelism based on
2D device meshes and construct a search space. Combined with the hierarchical
communication matrix, ATP can identify the optimal strategy in the search
space. We also propose chunk-based overlapping to reduce communication
overhead. Our evaluations show ATP consistently outperforms the
state-of-the-art approaches for various model sizes and interconnects,
achieving end-to-end training performance improvements of up to 37-64% on
specific interconnects. Based on our theoretical model, the communication
overhead of ATP decreases with scaling, indicating a qualitative leap forward
Auto-Encoding Adversarial Imitation Learning
Reinforcement learning (RL) provides a powerful framework for
decision-making, but its application in practice often requires a carefully
designed reward function. Adversarial Imitation Learning (AIL) sheds light on
automatic policy acquisition without access to the reward signal from the
environment. In this work, we propose Auto-Encoding Adversarial Imitation
Learning (AEAIL), a robust and scalable AIL framework. To induce expert
policies from demonstrations, AEAIL utilizes the reconstruction error of an
auto-encoder as a reward signal, which provides more information for optimizing
policies than the prior discriminator-based ones. Subsequently, we use the
derived objective functions to train the auto-encoder and the agent policy.
Experiments show that our AEAIL performs superior compared to state-of-the-art
methods on both state and image based environments. More importantly, AEAIL
shows much better robustness when the expert demonstrations are noisy.Comment: 15 page
Dynamic coupling modelling and application case analysis of high-slip motors and pumping units
To solve the issues and difficulties in the high-coupling modelling of beam pumping units and high-slip motors, external characteristic experiments of high-slip motors were performed where the external database and characteristic correlation equations of the motors were obtained through data regression analysis. Based on the analysis of the kinematics, dynamics and driving characteristics of the beam pumping unit, a fully coupled mathematical model of a motor, pumping unit, sucker rod and oil pump was established. The differential pumping equation system of the pumping unit used a cyclic iteration method to solve the problem of high coupling among the motor, pumping unit, sucker rod and the pumping pump. The model was verified by experimental data of field l pumping wells. Theoretical calculations and experimental tests showed that the soft characteristic of the high-slip motor can reduce the peak suspension load of the sucker rod, peak net torque of the gearbox and peak power of the motor. In addition, the results show that the soft characteristic can also decrease the high-frequency fluctuation of the motor power curve and the torque curve of the gearbox. The highslip motor can improve the smoothness and safety of the pumping well system
- …